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Abstract : 

This report describes an approximation for the central 
processor (CPU) utilization in a multiprogramming computer 
system. The approximation is based on use of the mathematical 
theory of diffusion; its adequancy is checked numerically and 
found to be good. 



1. INTRODUCTION. 



Several authors have recognized that interesting characteristics 
of multiprogramming computer systems may be obtained by analysis of 
the cyclic queues occurring at CPU (Central Processor Unit) and DTU 
(Data Transmission Unit); see Gaver [3], Lewis and Shedler [5], 

Shedler [8], [9], and others. A system feature that complicates the 
probability analysis is the non-Markovian nature of DTU service: 
while it may be roughly plausible to assume CPU service times (e.g., 
times to page fault) to be independently and exponentially distributed, 
it is apparently much less reasonable to make such a distributional 
assumption about DTU service times. Although straightforward attacks 
on this problem have been successfully conducted, see [5] and [8], it 
may be useful to attempt a simpler, approximate, approach, and this 
is the objective of the present paper. The results obtained here have 
the virtue of a refreshing mathematical simplicity, but are of course 
only in approximate agreement with results such as those obtained in 
[8]. When we reflect that our present models for multiprogramming 
are quite simplistic in the light of current knowledge of a) program 
behavior at the CPU, b) information accessing at the DTU, and c) 
representation of storage hierarchies, approximations of this type may 
be quite adequate for providing insights. We envision using results 
of this kind to design computer systems with acceptable cost-perform- 
ance characteristics. Such results are useful, for example, in 
suggesting performance characteristics of devices which will result 
in a balanced system. In addition, by taking cost characteristics 
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into account, one can begin to evaluate technologies from a total 
system point of view, and thus be guided to select appropriate devices. 
With respect to such questions we can consider utilizing our results 
to obtain an initial idea of the region of parameter space to explore 
more extensively by means of simulation or by improved analytical 
approximations, several of which are currently under development. 
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2. THE DIFFUSION APPROXIMATION. 

We consider the cyclic queueing system (see Figure 1) which 
consists of two sequential stages. The system is assumed to serve a 
constant number, J, of programs (J ^2), each of which goes through 
both stages in sequence and then returns to the first stage, this pro- 
cess being repeated continuously. It is assumed that after completion 
of CPU service a program moves instantaneously from stage 1 to the tail 
of the queue in stage 2, and after DTU service at that stage, back to 
the tail of the queue in stage 1. We shall suppose in addition that 
the queue in front of the CPU and the queue in front of the DTU are 
served according to a First-In-First-Out (FIFO) discipline. The assump 
tion that J is a constant is an approximation that is justified by 
the common practice of operating such a system in a saturated mode. 

In addition, we assume that the service times at the CPU and 
the DTU are mutually independent, and that CPU service times and DTU 
service times, respectively, are identically distributed. 

We attempt here to give a brief intuitive account of our approxi 
mation. Let N (t) denote the number of programs present at the CPU 

L* 

at time t; this includes those queued in addition to the program 

currently in service. Then if N (0) = 0, 

c 

N c (t) = A(t) - D ( t) (2.1) 

where A(t) represents the number of arrivals at the CPU in (0,t), 
and D(t) is the number CPU departures in (0,t). If we neglect 
boundary effects at 0 and J, A(t) and D(t) are independent 
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renewal processes, so as t becomes large A(t) and D(t) are 

t , t 



approximately normally distributed with means 



EfD] 



and 



E[S] 



, . Var [D ] , Var [S ] . , „ 

and variances t an< ^ t "(~ E ~ [ s ' ]) 3 ' res P ectlve ly > see Cox [1]» 

p. 40. It follows that N^(t) is approximately normally distributed 

~ Var[D] Var [S]" 



with mean yt = [j^y - ^ t and 



variance o 2 t = 



_(E[D])^ (E[S]) a _ 

We now approximate by replacing the difference of renewal processes 

by a diffusion (Wiener process) with drift p and infinitesimal 

variance a 2 . Thus, F(x,t), the distribution of N (t) , satisfies 



the diffusion equation 
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again approximately; cf. Newell [7], pp . 105-107. A reflecting 
boundary condition at x = 0 must be imposed, for N (t) ^ 0, and 
another such boundary condition at x = J constrains N (t) to be 
£ J. We require the solution to (2.3), subject to an initial distri- 
bution, e.g. 



F(x,0) = 



1, x ^ Xq > 0 



°> x < x 0 > 



(2.3) 



and boundary conditions 



F (0+ , t) £ 0, 



F(J,t) - 1. 



(2.4) 



For further details of the behavior of this approximation when J is 
infinite see Gaver [4]. For a closed form solution to (2.3) when J 
is infinite, see Newell [7]. 



